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EXECUTIVE  SUMMARY 


The  purpose  of  this  report  is  to  identify  and  evaluate  current 
factors  that  place  development  programs  in  that  category 
called  "major".  Four  categories  of  major  programs  were 
considered:  DSARC  Programs;  Major  programs  per  DOD  Budget 

Manual;  Major  Programs  per  OMB  and  progams  requiring  Sec  Air 
Force/HQ  USAF/HQ  AFSC  formal  reviews.  Due  to  time  and  data 
access  constraints,  only  Air  Force  programs  were  included  in 
this  review  except  in  the  case  of  the  DSARC  programs  where 
data  from  all  three  services  was  available.  In  addition  to 
considering  existing  major  program  criteria,  the  impact  of 
the  proposed  Milestone  0 decision  (considers  mission  analysis 
and  need)  is  also  included. 

Major  development  programs  per  the  DOD  Budget  Manual  are  all 
those  that  have  $50M  total  R&D  costs  and/or  $200M  investment 
costs.  In  the  FY  1977  Air  Force  Budget  there  were  thirty-five 
programs  in  this  category.  Similar il'y,  DSARC  programs  have 
the  same  dollar  threshold  with  the  recent  added  note  that  these 
numbers  are  in  unescalated  FY  72  dollars.  OMB  in  their  recent 
Major  System  Acquisition  Policy  circular  left  the  setting 
of  dollar  thresholds  with  the  developing  agency,  however,  they 
did  establish  the  policy  that  a more  comprehensive  review  of 
the  need  was  required  at  the  "front-end"  of  the  program.  This 
factor  plus  the  overloading  of  the  DSARC  principals  with  too 
many  DSARC  programs  to  keep  track  of,  are  the  apparent  reasons 
for  the  new  4 step  acquisition  process  being  proposed  by  DDR&E. 
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Milestone  0 would  be  added,  however,  the  Service  Secretaries 
would  assume  seme  Milestone  1 (DSARC  1)  review  responsibility 
and  the  monitoring  of  Milestone  3 (DSARC  3)  production. 

It  was  concluded  that  the  answer  to  the  question,  "Who  says  you 
have  a Major  Program?",  is  the  Secretary  of  Defense  and/or 
the  OSD  Comptroller.  The  explicite  cost  criteria  established  by 
the  DOD  Budget  Manual  ensured  that  fairly  detailed  data  on  a 
relatively  large  number  of  major  programs  (compared  to  the 
number  of  DSARC  programs)  will  be  forwarded  to  Congress. 

However,  these  same  dollar  amounts  appear  to  be  only  about 
one-half  the  minimum  required  to  be  designated  a DSARC  program. 


SECTION  I 
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INTRODUCTION 

Purpose;  Based  on  previous  experience  in  the  United  States 
Air  Force  Research  and  Development  business  and  the  subject 
material  covered  in  the  Defense  Systems  Management  School's 
Program  Management  Course,  the  definition  of  what  constitutes 
a "major"  program  appeared  to  vary  depending  on  who  was 
assigning  the  label.  In  addition  to  these  programs  designated 
major  by  the  Secretary  of  Defense  per  Department  of  Defense 
Directive  5000.1,  other  levels  in  the  government  bureaueratic 
hierarchy  also  designated  certain  programs  as  major.  The 
consequences  of  being  so  designated  are  certain  management, 
reporting,  travel  and  briefing  requirements  (visibility)  which 
are  not  required  of  the  non-major  programs.  This  report 
reviews  this  process  with  the  purpose  of  identifying  the  main 
consideration (s)  in  designating  a program  as  major,  thus 
providing  some  insight  for  program  managers  who  have  told 
they  have  a major  program  and  must  immediately  prepare  and 
forward  to  Headquarters  certain  program  information,  reports, 
etc. 

Study  Goals:  Intuitively  it  is  reasonable  to  expect  that 

program  acquisition  cost  would  be  the  main  (and  perhaps  only) 
significant  factor  used  to  determine  if  a program  should  be 
designated  as  major  regardless  of  who  in  the  hierarchy 
makes  the  determination.  It  is  this  program  cost  aspect 
* 
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which  will  be  examined  in  detail  to  determine  the  role  it 
plays.  In  addition,  cost  data  from  the  various  programs  now 
designated  major  will  be  evaluated  to  determine  what  the 
current  cost  threshold  is  for  major  programs.  A third  area 
of  consideration  is  to  see  if  there  is  any  evidence  that 
development  efforts  are  combined  or  separated  in  order  to 
ensure  or  avoid  being  designated  a major  program. 

Scope  and  Limitations;  The  study  considered  all  the  current 
USAF  development  and  production  programs  which  is  a limitation 
in  the  sense  that  Army  and  Navy  programs  are  not  included. 

It  was  not  possible  in  the  time  available  to  become  familiar 
enough  with  the  other  service  programs  to  adequately  address 
them  in  this  study.  However,  approximate  acquisition  cost 
figures  are  included  and  considered  for  those  Army  and  Navy 
programs  designated  major  by  the  Secretary  of  Defense.  As  a 
result,  this  study  primarily  addresses  the  USAF  development 
programs  in  an  attempt  to  perceive  what  the  Department  of 
Defense  and  the  Congress  consider  important  enough  to  warrant 
their  playing  a role  in  the  program's  management. 

Report  Organization:  The  body  of  this  report  is  separated 

into  two  main  sections  (in  addition  to  this  introductory 
section)  with  summary  comments  at  the  end.  The  first 
research  objective  was  to  specifically  identify  who,  based 
on  current  regulations,  directives,  and  practices  can  identify 
a program  as  major.  The  results  are  reported  in  Section  II 
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and  includes  a description  of  the  process,  the  stated  criteria 
for  selection,  and  some  of  the  ramifications  of  a program 
being  so  designated.  Having  identified  the  who  and  how,  this 
baseline  data  is  evaluated  in  Section  III  in  order  to  determine 
what  the  apparent  thresholds  are  for  major  programs. 


SECTION  II 


MAJOR  PROGRAM  DESIGNATION 

Based  on  recent  experience  with  the  programming  and  budgeting 
of  the  USAF  RDT&E  funds,  it  was  apparent  that  several 
different  people  could  require  the  generation  of  special 
descriptions,  reports,  and  briefings  on  what  were  identified 
as  major  programs.  Specifically  these  include  the  Secretary 
of  Defense  and  the  Defense  Systems  Acquisition  Review  Council 
(DSARC)  programs,  major  systems  according  to  the  Office  of 
Management  and  Budget  (OMB) , programs  meeting  the  Department 
of  Defense  Budget  Guidance  Manual,  and  programs  requiring 
Secretary  of  the  Air  Force/Headquarters  USAF/Headquarters  AFSC 
assessment  reviews.  The  requirements  which  must  be  met  to 
qualify  as  a major  program  according  to  each  of  these  categories 
are  described  in  the  following  paragraphs. 

SAF/HQ  USAF/HQ  AFSC  Assessment  Reviews:  Secretary  of  the  Air 

Force  Program  Reviews  (SPR's)  are  management  reviews  on  all 
aspects  of  selected  major  programs  of  high  national  and 
departmental  priority  and  importance  ( 1 : 5) 1 . Currently  the 
Secretary  has  designated  sixteen  programs  for  review  quarterly 
or  semi-annually  (2:  Atch  2,1&2).  Prior  to  presentation  to 
the  Secretary,  the  program  is  reviewed  at  HQ  AFSC  and  at 
HQ  USAF.  HQ  AFSC  calls  this  a Program  Assessment  Review  (PAR) 
or  more  commonly  a PAR/SPR  (3:1).  This  information  presented 

^This  notation  will  be  used  throughout  the  report  for 
sources  of  quotations  and  major  references.  The  first  number 
is  the  source  listed  in  the  bibliography.  The  second  number 
is  the  page  in  the  reference. 
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at  the  SPR  is  basically  similiar  (same  format)  as  that 
presented  at  the  HQ  AFSC  PAR.  The  presentation  sequence  for 
this  20  to  30  minute  briefing  by  the  program  manager  is  first 
to  the  HQ  AFSC  Commander  and  his  key  staff,  then  to  the  Air 
Force  Council  (HQ  USAF  DCS  level,  3-star  Generals)  and  Air 
Staff  Board  (key  2-star  Directors  chaired  by  the  Director  of 
Programs)  in  joint  session.  Finally  the  presentation  is  made 
to  the  Secretary  and  the  Chief  of  Staff.  It  is  normal  for 
these  presentations  to  span  a two  or  three  day  period.  In 
addition  to  these  programs  reviewed  at  the  Pentagon,  HQ  AFSC 
conducts  reviews  of  programs  selected  by  the  AFSC  Commander 
which  are  of  lesser  priority  and  importance  then  the  PAR 
programs.  This  is  the  Command  Assessment  Review  (CAR)  which 


is  also  normally  conducted  quarterly,  spans  30  minutes,  and 
covers  program  status  and  progress  (3:1).  Currently  there 


are  44  CAR  programs  (2:  atch  2,  2-5)  . All  other  programs 
managed  by  AFSC  (those  not  included  in  the  SPR/PAR/CAR 
reporting)  follow  the  Management  Assessment  Review  (MAR) 

K 

process  which  provides  for  monthly  written  reports  by  the 
program  manager  (quarterly  for  programs  less  than  1 million 
dollars) . The  AFSC  field  activity  is  responsible  for  conducting 
this  review  to  assess  progress,  current  and  future  status, 
and  existing  or  potential  problems  throughout  the  period  that 
AFSC  is  responsible  for  the  program  (4:  1,3). 

POD  Budget:  The  preparation  of  the  DOD  budget  each  year  is 

accomplished  per  direction  of  the  Office  of  the  Assistant 
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"“cretary  of  Defense  (Comptroller)  who  publishes  the  DOD 
Budget  Guidance  Manual.  This  manual  provides  direction  to 
the  services  on  how  to  prepare  and  what  to  include  in  the 
October  Budget  Submission  to  OSD  and  the  justification 
material  forwarded  to  Congress.  Included  in  the  justification 
material  for  the  RDT&E  Appropriation  is  a volume  titled 
"Supporting  Data  for  Fiscal  Year  1 9BY  Budget  Estimates  - Major 
Programs."  Major  is  defined  as  50  million  dollars  or  more 
(over  life  of  development  or  production)  in  RDT&E  and/or 
200  million  dollars  or  more  in  investment  (over  life  of  devel- 
opment or  production) . All  programs  that  meet  these  dollar 
thresholds  must  provide  test  and  evaluation  data  and  program 
milestone  data  over  and  above  the  data  provided  by  lesser 
programs  (5:  325-1,4).  In  the  FY  1977  Air  Force  budget  there 
were  thirty-five  programs  in  this  category  (6).  The  HQ  USAF 
Director  of  Budget  (AF/ACB)  also  prepared  a summary  of  the 
FY  1977  President's  Budget  which  included  a list  of  twenty- 
eight  programs  identified  as  major  systems  (7:4,5). 

DSARC  Programs : Prior  to  the  July  1971  publication  of 

Department  of  Defense  Directive  5000.1,  Acquisition  of  Major 
Defense  Systems,  "particular  systems/projects"  were  managed 
per  Department  of  Defense  Directive  5010.14.  This  directive, 
titled  "System/Project  Management",  stated  that  certain 
programs  meeting  specific  criteria  would  use  what  has  now 
become  commonly  known  as  the  program  manager  method  of 
management,  i.e.,  single  individual  with  appropriate 
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^sponsibility  and  authority.  The  criteria  included  systems/ 
projects  which: 


a.  Are  rated  in  the  Brick-Bat  category  of  the  National 
and  Military  Urgency  Determinations. 

b.  Are  estimated  to  require  total  RDT&E  financing  in 
excess  of  twenty-five  million  dollars,  or  estimated 
to  require  total  production  investment  in  excess 

of  one  hundred  million  dollars. 

c.  Are  designated  by  the  Secretary  of  Defense  or  Head 
of  a DOD  Component  based  on  effect  on  military 
posture,  programs  which  are  closely  related  and  meet 
dollar  thresholds,  urgent,  involve  organizational 
complexity,  technology  advancement,  and  high  RDT&E/ 
production  concurrancy. 

The  directive  also  states,  however,  that  discretion  should  be 
exercised  in  optional  application  of  this  exceptional 
management  technique  (8:1,4). 

DODD  5000.1  replaced  5010.14  in  July  1971  and  established  a 
new  policy  for  acquisition  of  major  defense  systems  by  the 
Military  Departments  and  Defense  Agencies.  The  program 
management  philosophy  remained  the  same  where  a single 
individual  has  a charter  which  defines  his  responsibility  and 
authority;  however,  the  criteria  for  program  application  was 
changed  in  order  to  achieve  a greater  degree  of  management  by 
the  DOD  Components  (decentralized  management) . This  management 
by  exception  approach  did  make  one  other  significant  change. 
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The  Defense  Systems  Acquisition  Review  Concil  was  established 
with  the  purpose  of  making  recommendations  to  the  Secretary 
of  Defense  regarding  approval  for  the  program  to  proceed  to 
the  next  key  decision  milestones,  i.e.,  conceptual  to 
validation  phase  ( DSARC  I) , validation  to  full-scale 
development  (DSARC  II),  and  full-scale  development  to 
production/operational  (DSARC  III)  , in  the  development/ 
acquisition  process.  The  baseline  for  conducting  each  of  these 
reviews  is  established  in  the  Decision  Coordinating  Paper  (DCP) 
which  is  usually  prepared  in  draft  by  the  program  manager. 

Application  of  this  directive  was  intended  primarily  for  major 
programs  but  the  management  principles  are  considered  to  be 
applicable  to  all  programs.  The  single  criteria  for  specific 
application  of  this  directive  is  to  be  so  designated  by  the 
Secretary  of  Defense.  The  directive  further  states  that  this 
designation  shall  consider:  (1)  dollar  value  (programs  which 

have  an  estimated  RDT&E  cost  in  excess  of  50  million  dollars, 
or  an  estimated  Production  Cost  in  excess  of  200  million  dollars) ; 

(2)  national  urgency;  (3)  recommendations  by  DOD  Component 
Heads  or  Office  of  Secretary  of  Defense  (OSD)  officials 
(9:1,2).  In  December  1975,  the  dollar  criteria  was  ammended 
to  reflect  the  threshold  as  $50  million/$200  million  in 
FY  1972  dollars  (10:1).  There  are  currently  6s  programs  in 
the  DSARC/DCP  process  with  19  more  preliminarily  identified  to 
enter  the  process.  Of  these,  28  are  Air  Force  programs  (11). 

Certain  of  these  major  programs,  normally  those  past  DSARC  II, 
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require  quarterly  written  status  reports  called  Selected 
Acquisition  Reports  (SARs) . Most  of  the  SARs  are  forwarded 
to  the  Congress  to  keep  them  appraised  of  the  program  status 
and  are  intended  to  be  primarily  a financial  report.  An 
appropriate  analogy  is  the  financial  report  prepared  by  a 
company  for  its  stockholders.  Currently  51  programs  prepare 
SARs  (11  of  which  are  Air  Force)  and  49  are  forwarded  to 
Congress  (12:1) . 

OMB  Major  Systems:  The  Office  of  Management  and  Budget  (0MB) 

has  just  recently  published  (6  April  1976,  OMB  Circular 
No.  A-109)  new  policies  to  be  followed  by  executive  branch 
agencies  (which  includes  the  DOD)  in  the  acquisition  of  major 
systems.  This  OMB  Circular  is  a product  of  the  new 
Congressionaly  established  Office  of  Federal  Procurement  Policy 
within  OMB  and  has  a prime  objective  of  improved  economy, 
efficiency,  and  effectiveness  in  Federal  Procurement. 
Specifically  this  circular  requires: 

a.  Top  level  management  attention  to  determine  agency 
mission  needs  and  goals. 

b.  Earlier  direction  to  research  and  development  efforts 
to  meet  mission  needs  and  goals. 

c.  Improved  opportunities  for  innovative  private  sector 
contribution  to  meet  national  needs. 

d.  Avoidance  of  premature  commitments  to  full-scale 
development  and  production. 

e. ‘  Communicating  with  Congress  earlier  in  the  acquisition 

process  by  relating  major  systems  acquisitions  to 
agency  mission  and  goals. 
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Major  system  acquisition  programs,  as  defined  in  this  OMB 
Circular,  are  those  programs  that:  (1)  are  directed  at,  and 
critical  to  fulfilling  an  agency  mission;  (2)  entail  the 
allocation  of  relatively  large  resources;  and  (3)  warrant 
special  management  attention.  The  circular  further  states 
that  the  individual  agencies  may  establish  additional 
criteria  and  relative  dollar  thresholds  (13:1-12). 

In  the  following  section,  the  selection  criteria  described 
above  are  compared  and  evaluated  for  each  of  these  four 
categories  of  major  programs. 
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SECTION  III 


EVALUATION  OF  MAJOR  PROGRAM  DESIGNATION  CRITERIA 
DSARC  Programs : The  criteria  for  designation  of  major  programs 

by  the  Secretary  of  Defense  has  remained  essentially  the  same 
over  the  past  decade  except  for  the  dollar  thresholds.  Back 
in  1965,  DODD  5010.14  stated  that  System/Project  Management 
was  to  be  applied  to  programs  of  high  priority  and  of  significant 
importance  to  the  United  States  miliatry  posture.  The  July 

1971  and  December  1975  versions  of  DODD  5000.1  continued  the 
philosophy  that  the  use  of  a program  manager  was  the  best  way 

to  conduct  programs  of  high  national  urgency.  Dollar  thresholds 
did  change,  however,  from  the  1965  figure  of  $25  million 
RDT&E  and/or  $100  million  production  to  the  current  figure  of 
$50  million  RDT&E  or  $200  million  production  based  on 

1972  dollars.  When  DODD  5000.1  was  in  draft  form  back  in  1971, 
it  was  sent  to  AFSC  for  review  and  comments  according  to 

Col  Charles  Kenney  and  the  draft  version  contained  the  same 
$25M/100M  thresholds  as  its  predessor.  Their  review 
concluded  that  the  $25/1 00M  figure  was  unrealisticly  low  and 
they  recommended  that  the  threshold  be  at  least  doubled. 

Col  Kenney  said  he  was  never  certain  that  their  recommendation 
was  the  real  cause  of  the  change  to  $50/200M,  but  felt  that 
their  somewhat  arbitary  method  of  arriving  at  a better  figure 
is  a good  indication  of  the  relatively  minor  significance  OSD 
places  on  these  numbers  (15).  The  recent  addition  of  the 


escalation  factor  (use  of  1972  dollars)  has  had  the  effect 
of  increasing  these  numbers  by  30  to  40%,  i.e.,  $70M/280M 
using  FY  76  dollars. 

A review  of  all  68  of  the  current  DSARC  programs  (see  figures 
III-1  thru  3 on  the  following  pages)  revealed  that  only  six 
have  an  acquisition  cost  of  less  than  $250  million  and  a 
total  of  only  twelve  less  than  $500  million  (14:  Appendix  H) . 
Looking  at  just  the  Air  Force  programs,  two  programs  nearing 
completion  (TPN-19  TRACALS  and  the  COBRA  DANE  radar)  cost  less 
than  $250  million.  All  the  proposed  USAF  DSARC  programs  are 
in  excess  of  $400  million  except  the  HR  Maverick  which  is  a 
part  of  the  larger  laser  Maverick  program.  The  average  cost 
of  all  programs  is  $2.4B,  however,  programs  like  the  F-15, 

F-14,  B-1  and  TRIDENT  totaling  $56B  tend  to  skew  the  cost 
distribution  to  the  high  side. 

DSARC  Program  Criteria  and  the  Acquisition  Advisory  Group  (AAG) : 
The  AAG  was  chartered  by  the  Deputy  Secretary  of  Defense, 

Mr.  Clements,  in  April  1975  to  examine  and  assess  Service 
submitted  coments  regarding  the  management  of  weapon  systems 
acquisition  at  the  OSD  level.  Their  report  of  September  1975 
included  five  specific  findings  and  twenty-eight  recommendations, 
two  of  which  relate  to  the  subject  of  this  report.  The  first 
concerns  the  total  number  of  programs  OSD  can  effectively 
handle  using  the  DSARC  process  and  the  other  concerns  the 
formal  structuring  of  the  front  end  of  the  acquisition 
process.  Both  of  these  factors  appear  to  be  significant  in 
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CURRENT  DSARC  REVIEWED  PROGRAMS  (11) 
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the  future  determination  of  which  programs  will  be  developed 
using  the  DSARC  process  (14:  Vol  I,  5&7)  . 
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Number  of  Programs:  The  AAG  recommendation  concerning  number 

of  DSARC  program  reads : 

°That  the  number  of  major  acquisition  programs 
subject  to  formal  DSARC  process  at  OSD  level  be 
reduced  to  approximately  40  programs;  delegate 
responsibility  for  remainder  to  Service 
Secretaries  (14:  Vol  1,5). 

The  basis  of  this  recommendation  stems  from  problems  associated 
with  the  staff  and  line  functions  in  OSD.  Only  the  Secretary 
and  the  Deputy  Secretary  have  total  program  authority  and 
responsibility  within  OSD.  However,  such  line  authority 
can  hardly  be  expected  to  be  exercised  in  detail  by  the 
Secretary/Deputy  Secretary  on  the  approximately  80  programs 
now  subject  to  DSARC  actions.  The  nature,  frequency,  and 
detail  of  the  reviews  make  it  almost  impossible  for  the  DSARC 
principals  to  maintain  a reasonable  level  of  personal 
responsibility  for  all  DSARC  actions  and  the  result  is  a 
shift  of  this  responsibility  to  the  lower  echelons  of  the  OSD 
functional  staffs.  As  noted  in  the  comments  by  the 
Services,  this  allows  the  lower  echelons  to  become  involved 
in  program  details  without  regard  to  the  overall  impact 
on  programs  (14:  Vol  1,20). 

Deputy  Secretary  Clements  has  issued  direction  and  guidance 
in  response  to  this  and  other  recommendations  included  in 
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assigned  a significant  role  in  advising  the  Deputy  Secretary 
of  Defense  on  these  "front  end"  matters.  It  was  also  recom- 
mended this  front-end  activity  not  be  an  administrative 
extension  of  the  DSARC/DCP  process  (14:  Vol  1,6-7). 

Deputy  Secretary  Clements  actions  on  this  recommendation 
were: 

a.  I request  DDR&E , in  coordination  with  ASD  (PA&E) , 
to  develop  by  1 5 March  1976,  an  implementing  DOD 
Directive  to  structure  the  front  end  of  the  acquisition 
process  along  the  general  lines  of  AAG  recommendations. 

b.  DOD  Directive  5000.1  will  be  revised  to  indicate 
its  sequential  relationship  to  the  front  end  structuring 
of  the  major  weapons  system  acquisition  process; 
additionally  it  will  be  revised  to  indicate  that 
precise  performance  specifications  for  a weapon  system 
will  not  be  established  until  DSARC  II. 

d.  DDR&E  is  requested  to  advise  me  prior  to  1 March 
1976  concerning  the  feasibility  and  methodology  of 
assigning  WSEG  the  "front  end"  role  (16:3). 

DDR&E  Proposal  for  Front  End  Structuring:  In  response  to  the 

Deputy  Secretary  of  Defense  tasking,  DDR&E  has  made  a 
recommendation  concerning  the  best  way  to  implement  this 
front  end  review  (see  Figure  III-4) . The  proposed  full-cycle 
of  milestone  events  and  tasks  starts  with  the  Secretary  of 
Defense  approval  of  the  Mission  Element  Need  Statement  and 
ends  with  production/deployment.  The  process  consists  of 
four  milestone  events/tasks  as  follows: 
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a.  Milestone  0 - SecDef  decision  approving  Service 
Secretary's  statement  of  mission  deficiency  or  need 
followed  by  Service  action  to  identify  alternate 
solutions,  selection  of  options  or  option  for 
demonstration  and  preparation  of  DCP. 

b.  Milestone  I - SecDef  decision  to  proceed  with 
demonstration  followed  by  Service  action  to  complete 
the  demonstration  of  selected  options  or  option  and 
the  selection  of  systems  for  full-scale  development. 

c.  Milestone  II  - SecDef  decision  to  proceed  with 
full-scale  development  followed  by  Service  action  to 
complete  development  as  set  forth  in  the  approved 
DCP;  to  recommend  initiation  of  production. 

d.  Milestone  III  - SecDef  decision  to  proceed  with 
rate  production  followed  by  Service  action  to 
accomplish  the  production  task  as  stated  in  the 
approved  DCP  (17:2) . 

Note  that  the  above  reflects  all  decisions  will  continue  to  be 
made  by  the  Secretary  of  Defense.  However,  in  accordance  with 
the  Deputy  Secretary  of  Defense's  desires  for  more  decentralized 
management,  certain  Milestone  I reviews  will  be  conducted  by 
the  Service  Secretary  (16:2).  Draft  proposals  for 
implementing  this  direction  reflect  the  equivalent  of  a DSARC 
review  called  the  (Service)  Systems  Acquisition  Review  Council 
(S)SARC.  The  Service  Secretary  would  then  forward  the  results 


20. 


; 


__ 








of  his  review  and  a coordinated  DCP  to  the  Secretary  of 
Defense  for  the  Milestone  I decision.  Currently  it  appears 
that  the  Services  will  only  be  allowed  to  conduct  (S) SARC 
reviews  on  those  programs  which  are  essentially  contained 
within  the  service  mission.  Defense  wide  programs  such  as 
strategic  and  nuclear,  joint  services,  multi-national,  and 
C3/intelligence  would  continue  to  be  managed  using  the  DSARC 
practices.  Based  on  this  criteria,  it  is  estimated  that 
approximately  forty  percent  of  all  Milestone  I reviews  will 
be  conducted  by  the  Service  Secretary  (18:2,3). 

Given  that  DODD  5000.1  includes  criteria  for  determining 
when  the  DSARC  review  process  should  be  applied  and  the  fact 
that  a Milestone  0 review  and  approval  are  now  going  to  be 
required,  an  obvious  question  is  what  will  be  the  basis  for 
nominating  programs  for  Milestone  0 reviews.  Before  the 
introduction  of  the  Milestone  0 consideration,  preceeding 
paragraphs  in  this  section  pointed  out  the  evidence  that  the 
total  number  of  DSARC  programs  and  program  cost  appeared  to 
be  important  factors.  Although  no  specific  cost  threshold 
could  be  determined,  it  was  apparent  that  potential  Air  Force 
DSARC  programs  would  require  an  acquisition  cost  in  excess  of 
$400M  to  be  considered.  However,  estimating  acquisition  costs 
for  a not-yet-def ined  solution  for  an  operational  need  at 
Milestone  O is  extremely  difficult  and  one  could  easily  be 
off  by  100%.  As  a result  it  would  not  be  surprising  to  see 
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only  a few  billion  dollar  class  programs  enter  the  DSARC 

; I 

• process  at  Milestone  0. 

It  is  apparent  that  the  saturation  of  the  DSARC  process 

with  too  many  programs  was  beginning  to  occur  which 

L • . 

precipitated  the  decision  to  let  the  Service  Secretaries 

f 

handle  part  of  the  load,  i.e.,  certain  Milestone  I reviews 

j j plus  the  monitoring  of  those  programs  past  DSARC  III.  This 

<• 

consideration  plus  the  fact  that  there  are  several  current 

P I 

development  programs  which  meet  the  DSARC  dollar  threshold 
but  are  not  DSARC  programs  leads  to  the  conclusion  that  new 
programs  marginally  meeting  the  DSARC  criteria  will  probably 

* i 

not  be  included.  Referring  back  to  the  study  goals,  the 

| I 

combining  or  separating  of  development  efforts  to  ensure  or 

; | 

avoid  designation  as  a major  program  could  not  be  determined. 

; i 

However,  the  relative  saturation  of  the  DSARC  process  leads 
to  the  conclusion  that  any  such  maneuver  is  not  going  to  be 
adequate. 

1 .1 

DSARC  vs  Budget  Criteria;  As  described  in  Section  II  of  this 
report,  the  single  criteria  for  determining  if  you  have  a 
major  program  according  to  the  budget  people  is  strictly 
dollars  ($50M  RDT&E  and/or  $200M  investment) . A comparison 
of  the  list  of  35  major  budget  programs  (USAF)  vs  the  28 
Air  Force  DSARC  programs  (current  and  planned)  revealed  that 
there  are  currently  seven  development  programs  which  meet  the 
DSARC  cost  threshold  but  are  not  DSARC  programs.  This  further 
substantiated  the  conclusion  that  "real"  threshold  is  in 
excess  of  $400M.  Interestingly  the  $7.5B  Minuteman  program 
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xs  not  under  DSARC  review,  however,  a SAR  is  prepared  and 
submitted  to  Congress. 

DSARC  vs  OMB  Criteria:  The  only  substantial  difference  between 

the  DSARC  (DODD  5000.1)  criteria  for  a major  program  and  that 
stated  by  OMB  is  the  use  of  dollar  thresholds  in  DODD  5000.1. 

OMB  has,  however,  stated  the  requirement  for  the  services  to 
conduct  requirements/need  reviews  early  in  program  development. 
This  direction  has  evolved  into  a DDR&E  proposed  Milestone  0 
review.  Since  DODD  5000.1  can  be  viewed  as  the  implementing 
directive  for  OMB  Circular  No.  A-109,  any  list  of  major 
programs  should  be  the  same  for  both  criteria. 

DSARC  vs  Program  Reviews : A comparison  of  the  various  program 

assessment  reviews  with  current  and  proposed  DSARC  programs 
is  shown  on  the  next  page  and  on  pages  14  and  15.  There  did  not 
appear  to  be  any  specific  pattern  or  common  criteria  except 
in  the  case  of  the  SAR.  The  ten  most  costly  Air  Force  programs 
which  have  passed  DSARC  II  (except  Minuteman  which  seems  to 
be  a special  case)  all  require  SAR  reports.  These  same  ten 
(plus  five  others)  under  go  the  SPR/PAR  review  but  it  was 
not  apparent  that  cost  was  directly  related  to  selection  for 
this  review. 


PROGRAM  REVIEWS 


MAJOR 

PRGMS 


PROGRAM  TITLE 


AWACS 

TPN-19 

AMST 

0141  Stretch 

F-15 

Int  Ftr 

Maverick 

A-10 

Cobra  Dane 

F-16 

B-l 

ALCM 

MX 

Space  Shuttle 

NAVSTAR 

AFSATCOM 

DSCS  III 

AABNCP 

05  Mod 

Compass  Cope 

GBU-15 

PLSS 

OTH-B 

ATCA 

EF-111 

HR  Maverick 
Minuteman  III 
AIM-7F  (Navy) 
AIM-9L  (Navy) 
FLTSATCOM  (Navy) 


Last  SAR  - Mar  76 
Total  DSCS  Program 
Drone/RPV  (semi-annual) 

Request  for  semi-annual 

Total  Maverick  Program  (EO,  Laser/IIR) 

CAP  Review  Quarterly  (Q)  or  Semi-Annual  (S) 
Alternates  as  PAR 
TRACALS  Program 
AFLC  Program 

Includes  current  and  proposed  DSARC  Programs 


SECTION  IV 


SUMMARY 

Summary  of  Conclusions:  The  answer  to  the  question,  "Who  says 

you  have  a major  program?",  is  the  Secretary  of  Defense  and/or 
the  OSD  Comptroller.  If  your  program  has  been  so  designated 
by  the  Secretary  of  Defense  it  probably  means  that  your 
acquisition  cost  is  at  least  $400M  to  $500M.  It  will  also 
mean  that  you  will  be  facing  a new  DSARC  review  process  with 
four  decision  points  instead  of  the  current  three.  This  new 
decision  point  (Milestone  0)  is  at  the  "front  end"  of  the 
program  where  mission  area  analyses  and  mission  concept  studies 
(analyses  of  the  requirement)  will  be  reviewed.  It  is  also 
possible  that  your  Milestone  I (same  as  DSARC  I)  review  will 
be  conducted  by  your  Service  Secretary  instead  of  DDR&E  as 
a result  of  the  Secretary  of  Defense's  emphasis  to  decentralize 
parts  of  the  DSARC  process.  When  your  program  passes  DSARC  II 
and  if  it  is  in  the  upper  one-half  of  your  service's  major 
programs  (in  terms  of  acquisition  cost) , you  can  anticipate 
preparing  quarterly  program  financial  report  called  the  SAR 
which  will  be  forwarded  to  the  Congress  to  keep  them  abreast 
of  progress. 

Alternatively,  your  program  could  have  been  identified  as  major 
by  the  budget  people  based  on  cost  criteria  ($50M  RDT&E  and/or 
$200M  Investment)  which  means  your  program  will  have  high 
visibility  throughout  the  Service/OSD  budget  reviews.  In 
addition,  details  of  your  program  will  be  included  in  the 
supporting  data  package  sent  to  the  Congress  in  support  of 
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the  President's  Budget.  The  key  message  of  course  is  that  you 
should  attempt  to  become  fully  aware  of  who  in  Washington  is 
watching  your  program  and  what  the  corresponding  implications 


are. 

Recommendations : A recommended  follow-on  project  is  a 

detailed  review  of  the  proposed  new  four  step  program  review 
process  resulting  from  the  addition  of  the  Milestone  0 
decision  point. 
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